One of the Congress members said two more legislators would join the group.
Some members of the group want to join the ruling BSP.
Tamang, whose Sikkim Krantikari Morcha party won the state assembly elections held in April, took over as chief minister on May 27.